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SIMULATION  METHODOLOGY 


FINAL  REPORT 

Army  Research  Office  Contract  DAAG29-84-K-0030 

1.  Introduction 

This  contract  covered  the  period  March  1,  1984  to  December  31,  1987. 
The  participating  scientific  personnel  included  two  faculty  members  and 
seven  Ph.D.  students.  Three  of  the  students  completed  both  an  M.S.  in 
Statistics  and  a  Ph.D.  in  Operations  Research,  one  of  whom  also  earned  an 
M.S.  in  Operations  Research.  The  other  four  students  are  currently  Ph.D. 
candidates  in  Operations  Research,  one  of  whom  has  earned  an  M.S.  in 
Operations  Research  and  an  M.S.  in  Statistics. 

' '  The  main  thrust  of  our  research  has  been  in  developing  new  methods  for 
analyzing  the  output  from  computer  simulations.  The  technical  work  can  be 
divided  into  three  areas:  simulation  output  analysis,  variance  reduction, 
and  stochastic  optimization.  Below  we  mention  some  of  the  most  important 
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results  in  each  area. 

2.  Simulation  Output  Analysis 

Glynn  and  Iglehart  (Technical  Report  No.  8)  developed  theoretical  foun¬ 
dations  for  the  so-called  standardized  time  series  approach  introduced  by 
Schruben.  This  method  addresses  the  problem  of  estimating  a  steady-state 
parameter  for  a  process  satisfying  a  functional  central  limit  theorem 


(CLT).  In  this  approach,  rather  than  estimating  the  variance  constant 
appearing  in  the  CLT,  this  constant  is  cancelled  out  in  a  manner  reminiscent 
of  the  t-statistic.  The  method  has  a  number  of  interesting  variants  depend¬ 
ing  on  the  selection  of  a  certain  function.  One  of  these  selections  leads 
to  the  method  of  batch  means  with  a  fixed  number  of  batches. 

Birney  Titus  in  his  Ph.D.  Dissertation  (Technical  Report  No.  9)  studied 
the  problem  of  estimating  the  mean  of  a  stationary  autoregressive  (AR) 
process  of  fixed  order,  p.  In  previous  work  by  Jow  and  others,  it  has  been 
shown  that  simulation  output  from  an  asymptotically  stationary  process  can 
be  approximated  by  an  AR(p)  process.  Titus  developed  a  method  using  Edge- 
worth  expansions  for  constructing  modified  confidence  intervals  which  have 
better  coverage  characteristics  than  those  previously  available. 

Glynn  and  Iglehart  (1986)  considered  the  problem  of  estimating  the 
steady-state  central  moments  for  a  positive  recurrent  regenerative  process. 
In  this  paper  strong  laws,  central  limit  theorems  and  confidence  intervals 
were  obtained  and  illustrative  numerical  examples  presented. 

Haas  and  Shedler  (1986)  studied  regenerative  stochastic  Petri  nets. 
Petri  nets  constitute  a  modeling  formalism  that  is  different  from  that 
traditionally  used  in  stochastic  models  arising  in  operations  research. 
They  are  particularly  useful  in  modeling  a  variety  of  local  area  computer 
networks.  Haas  and  Shedler  developed  methods  for  constructing  confidence 
intervals  for  steady-state  parameters. 

Glynn  and  Iglehart  (1987)  obtained  a  joint  central  limit  theorem  for 
the  sample  mean  and  the  regenerative  variance  estimator  in  the  context  of 
regenerative  simulation.  This  result  has  led  to  a  number  of  interesting 
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consequences.  It  was  known  previously  that  the  variance  associated  with  the 
sample  mean  is  independent  of  the  return  state  used.  However,  from  this  CLT 
it  became  apparent  thru  numerical  examples  that  the  covariance  term  associ¬ 
ated  with  the  sample  mean  and  the  variance  estimator  should  also  be  indepen¬ 
dent  of  the  return  state  used.  This  has  subsequently  been  proved  by  Jim 
Calvin  and  will  appear  in  a  future  technical  report.  Also,  this  work  has 
shown  that  the  variance  of  the  variance  estimator  is  not  minimized  (neces¬ 
sarily)  by  the  state  having  the  smallest  expected  cycle  length  (in  contrast 
to  the  'folklore'  of  this  area);  a  better  heuristic  is  to  choose  a  frequent¬ 
ly  visited  state  in  the  'center'  of  the  space,  so  as  to  minimize  skewness/ 
asymmetry  effects.  Finally,  numerical  examples  have  shown  that  the  variance 
of  the  variance  estimator  can  be  very  large. 

Glynn  (1988)  developed  a  new  low-bias  steady-state  estimator  for  equi¬ 
librium  processes.  Steady-state  estimators,  such  as  the  ratio  estimators 
which  arise  in  regenerative  simulation,  are  normally  biased  (although  asymp¬ 
totically  unbiased).  Glynn  has  computed  the  first-order  bias  term  which  can 
be  estimated  from  the  simulation  data.  The  estimate  for  this  bias  term  can 
then  be  subtracted  from  the  classical  estimate  to  obtain  the  low-bias  esti¬ 
mate.  Numerical  examples  have  shown  that  this  estimator  is  very  effective 
in  reducing  bias. 

3.  Variance  Redaction  Techniques 

The  method  of  control  variables  generally  assumes  that  the  expected 
values  of  the  control  variables  are  known  exactly.  Glynn  and  Iglehart 
(Technical  Report  No.  17)  considered  the  case  where  these  expected  values 
are  only  known  asymptotically.  In  this  paper  the  optimal  linear  combination 
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of  controls  is  derived*  This  analysis  is  particularly  relevant  to  the 
small-sample  theory  for  control  variates  as  applied  to  the  steady-state 
estimation  problem. 

Fox  and  Glynn  (Technical  Report  No.  23)  studied  the  problem  of  esti¬ 
mating  the  expected  infinite-horizon  discounted  cost  d  of  running  a  sto¬ 
chastic  system.  By  exploiting  various  types  of  stochastic  structure  they 
are  able  to  construct  estimators  that  exhibit  smaller  variances  than  the 
naive  strategy  of  estimating  a  finite-horizon  approximation  to  d. 

Importance  sampling  is  one  of  the  classical  variance  reduction  tech¬ 
niques  that  has  been  used  in  the  evaluation  of  integrals.  Glynn  and 
Iglehart  (Technical  Report  No.  24)  have  used  importance  sampling  in  the  con¬ 
text  of  discrete  and  continuous  time  Markov  chains  and  generalized  semi- 
Markov  processes.  This  method  is  also  shown  to  lead  to  variance  reduction. 

4.  Stochastic  Optimization 

Glynn  (Technical  Report  No.  14)  has  studied  the  case  of  a  discrete-time 
Markov  chain  whose  transition  matrix  depends  on  a  parameter  8.  Let  a(9) 
denote  the  steady-state  cost  of  running  this  system  per  unit  time.  Numeri¬ 
cal  and  simulation  methods  are  derived  for  calculating  and  estimating  the 
gradient  of  a (9).  These  gradient  estimates  have  also  been  used  to  develop 
convergent  simulation  algorithms  for  optimizing  complex  stochastic  systems 
in  which  the  decision  parameters  are  continuous. 

The  likelihood  ratio  method  has  been  developed  recently  in  order  to 
estimate  the  gradient  of  the  cost  of  running  a  stochastic  system  that 
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depends  on  a  parameter  9.  Glynn  (Technical  Report  No.  26)  surveys  this 
method  and  its  application  to  transient  and  steady-state  problems.  For  the 
steady-state  problem  both  regenerative  and  non-regenerative  approaches  are 
discussed. 

5.  Scientific  Personnel 

The  following  scientific  personnel  were  supported  on  this  contract: 
Faculty  supported: 

Donald  L.  Iglehart,  Principal  Investigator 
Peter  W.  Glynn,  Co-investigator 

Students  supported: 

Birney  D.  Titus,  earned  M.S.  in  Statistics  and  Ph.D.  in  Operations 
Research. 

Peter  J.  Haas,  earned  M.S.  in  Statistics  and  Ph.D.  in  Operations 
Research. 

Lindsay  Prisgrove,  earned  M.S.  in  Statistics  and  Ph.D.  in  Opera¬ 
tions  Research. 

James  Calvin,  Ph.D.  candidate  in  Operations  Research. 

Chia-Hon  Chien,  earned  M.S.  in  Statistics  and  M.S.  in  Operations 
Research,  Ph.D.  candidate  in  Operations  Research. 

Nayyar  P.  Shahabuddin,  Ph.D.  candidate  in  Operations  Research. 

Scott  D.  Schulz,  Ph.D.  candidate  in  Operations  Research. 
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